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ABSTRACT 

This work focuses on the convergence analysis of adaptive dis- 
tributed beamforming schemes that can be reformulated as local 
random search algorithms via a random search framework. Once re- 
formulated as local random search algorithms, it is proved that under 
two sufficient conditions: a) the objective function of the algorithm 
is continuous and all its local maxima are global maxima, and b) the 
origin is an interior point within the range of the considered trans- 
formation of the random perturbation, the corresponding adaptive 
distributed beamforming schemes converge both in probability and 
in mean. This proof of convergence is general since it can be applied 
to analyze randomized adaptive distributed beamforming schemes 
with any type of objective functions and probability measures as 
long as both the sufficient conditions are satisfied. Further, this 
framework can be generalized to analyze an asynchronous scheme 
where distributed transmitters can only update their beamforming 
coefficients asynchronously. Simulation results are also provided to 
validate our analyses. 

Index Terms — Beamforming, convergence analysis, dis- 
tributed algorithms, feedback communications. 

1. INTRODUCTION 

In a distributed network, distributed beamforming is considered as 
a promising scheme that allows distributed transmitters to convey 
common information efficiently in energy due to its potential array 
gain and low-complexity. However, to achieve distributed beam- 
forming, or phase alignment, channel state information (CSI) at the 
transmitters is required and the cost of obtaining perfect CSI is too 
expensive in practice. Therefore, instead of obtaining perfect CSI, 
an adaptive scheme that uses a one-bit feedback link to acquire par- 
tial CSI at the transmitter ends was proposed in 1 1|, and the analyses 
of this one-bit feedback adaptive scheme have been extensively stud- 
ied in |2|-|6|. In |3|, |4|, a discrete version of the one-bit adaptive 
scheme with binary signaling is considered. To analyze the behavior 
of the one-bit adaptive scheme, the authors in 1 5 1 applied stochas- 
tic approximations to show the convergence of the scheme. It has 
been shown that the sample path of the one-bit adaptive scheme ap- 
proximately follows an ordinary differential equation under suitable 
conditions, and the convergence of the scheme is established accord- 
ingly. Alternatively, the one-bit adaptive scheme was reformulated 
as a local random search algorithm via a random search framework 
and analyzed in our previous work |6|. This reformulation allows us 
to use the techniques studied in the mature field of random search 
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for systematically analyzing the characteristics of the one-bit adap- 
tive scheme. With the help of this framework, it has been shown, 
without any approximation, that the one-bit adaptive scheme con- 
verges both in probability and in mean, and its convergence time 
scales linearly with the number of distributed transmitters. 

In this paper, we further generalize the framework in |6| and 
provide a more general proof of convergence and linear scalability 
for adaptive distributed beamforming schemes. We show that any 
adaptive distributed beamforming scheme that can be reformulated 
as a local random search algorithm converges both in probability and 
in mean if the algorithm satisfies two sufficient conditions for the 
objective function and the random perturbation. This framework is 
more general since once the sufficient conditions are satisfied, there 
is no need to specify the objective functions and probability mea- 
sures. Instead of focusing on a particular objective function and 
symmetric probability measures as in 1 1 1, [5], |6|, our framework 
can be applied to analyze a much broader set of adaptive distributed 
beamforming schemes and hence provide more potential to unify 
theoretical analysis in this field. Furthermore, since the transmitters 
are deployed in a distributed fashion, it is possible that they experi- 
ence different environments that cause their local clocks to be asyn- 
chronous. Our framework can be further extended to analyze adap- 
tive distributed beamforming schemes in such asynchronous setting 
by a straightforward application of Bayes' rule. 

2. SYSTEM SETUP 

We consider a network with N distributed transmitters that attempt 
to convey a common message to the receiver. We assume that all 
transmitters and the receiver are equipped with one antenna and the 
channels between each transmitter and the receiver are slow faded 
and frequency flat. Furthermore, we assume a noncoherent com- 
munication model where both the transmitters and the receiver do 
not have CSI. However, there is an error-free, zero-delay, and low- 
rate feedback link from the receiver to each transmitter so that the 
receiver can help aligning the beamforming phases through this re- 
verse feedback link. The discrete-time, complex baseband received 
signal can be expressed as 

JV JV 

y[n] = higi[n]s[n]+w[n] = ajh [n]e 3 +l/>i W ) s [n]+w[n] 

1=1 i=l 

(1) 

where y[n] £ C is the received signal, s[n] £ C is the common 
message with the average power constraint _B[|s[n]| 2 ] < P B for all 
n, and w[n] ~ CAf(0, a ) is the additive white Gaussian noise. For 
transmitter i, we denote the time-invariant channel fading gain by 
hi = a»e'*'* 6 C, and the beamforming coefficient by gi[n] — 



& i [n]e il/ ' i[nl g C. For simplicity, we set s[n] = y/K and bi[n] = 1 
and focus on the phase alignment during the training stage. 
The SNR function at the receiver is given by 

SNR(0[n]) = -J j L (2) 

where 0[n] = [#i [n], . . . , #zv[n]] T and flj[n] = 0; + ^[n] ' s me 
total phase received at the receiver from transmitter i. The goal is 
to maximize the SNR(-) so that the receiver can recover the signal 
with minimum error. However, since the receiver has neither the 
knowledge of CSI nor the objective function, i.e., the SNR function, 
it can only estimate a sample of the SNR function at each iteration. 
Therefore, this adaptive distributed beamforming problem can be re- 
formulated as the problem stated as follows (6): 

Problem 1: Given an unknown objective function / : — > R, 
where C M. N , and only samples of f(0) are available for any 
G 0, find the global maxima of /. 

This problem cannot be solved by gradient search method since 
there is no knowledge on the objective function and its gradient at 
the transmitter end in our case. However, from our previous work 
(6), it can be solved by global random search algorithms in general. 
Further, if all the local maxima of the objective function are global 
maxima, local random search algorithms, which are more efficient, 
can also be applied. 

3. GENERAL PROOF OF CONVERGENCE AND LINEAR 
SCALABILITY 

In this section, we provide a more general proof for the conver- 
gence and linear scalability of a set of adaptive distributed beam- 
forming problems that can be reformulated as local random search 
algorithms. To this end, we briefly describe the local random search 
algorithm in | 6| as follows: 

• Step zero: Initialize the algorithm by choosing 0[0] G 0. 

• Step one: Generate a random perturbation S [n] from the prob- 
ability measure /i„ that could be time-varying and has the 
support supp(/i„). 

• Step two: Update the search point by 0[n] = D(0[n — 
l],S[n]), where the mapping D : x supp(^t n ) — > 
satisfies the condition that 

f(D(0[n-l],S[n]))>f(0[n-l]) 

In most cases, the mapping D can be expressed as 

D(0[n - 1], 5[n]) 

= 0[n - 1] + Gn(<5M)l{/(0[„_l]+G„(<5[n]))>/(e[n-l])} (3) 

where l/.j is the indicator function and G„ : supp(p n ) — > T n C 
R" can be a general transformation. Note that and T n are in the 
same space, i.e., R*. 

Now, referring to the local random search algorithm described 
above, we further provide two sufficient conditions for our proof. 

(51) The objective function / is continuous and all its local max- 
ima are global maxima. 

(52) The origin is an interior point of the range of the transforma- 
tion G„, i.e., T n , for all n. 

In the following analyses, we consider local random search algo- 
rithms that satisfy both the sufficient conditions. Note that we do not 
need to specify the exact expressions of the objective function and 
the probability measure once the sufficient conditions are satisfied. 
This makes our proofs much more general than those in |6|. 



3.1. Convergence 

We first define the convergence in probability as follows. 

Definition 1 A sequence {0["-]}^L o generated by a random search 
algorithm is said to converge in probability if given e > 0, 

lim Pr[0[n] £ R e ] = 1 

n — >oo 

where 

Re := {0 € Q : f(0) > / (0*) - e} 

is the e-convergence region. In other words, f(0[n]) converges to 
f(0*) in probability, where 0* is a global maximum point. 

Now, we further derive two propositions for the proof of con- 
vergence. For notational simplicity, we omit the time indices and 
write 0, 8 instead of 0[n], S[n] in the following propositions and the 
corresponding proofs. 

Proposition 1 Given an objective function f and a transformation 
G n with domain supp(/i n ) that satisfy the sufficient conditions (SI) 
and (S2). Let D be the mapping as defined in l[3j, then for any G 
\ R ( , there exists a set A(0) C Range{D(0, ■)} with nonempty 
interior points, such that /(a) > f(0) for all a G A(ff), where 
Range{D(0, ■)} is the range of the mapping D at 0. 

Proof: We begin the proof by defining a /(0)-superlevel set 

Ue '■= {if> £ : /WO > f(0)} 

which is the subset of with all the elements in Ue mapping to 
function values no less than f(0). Note that the assumption £ R c 
implies that R t C Ue and since R t is nonempty, Ue is nonempty. 
Furthermore, since / is continuous, the boundary points are those 
points that satisfy f(ip) = /(#)• 

We claim that for any £ > 0, there exists a set A(0) C B(0, f )n 
Ue with nonempty interior points, such that /(a) > f{0) for all 
a G A(0), where B(0, £) is an open ball centered at with radius 
£. To this end, we first rule out the case where there are flat regions 
outside R t , that is, for some £ R t , there exists a C, > such that 
f(tf>) = f(0) for all ip G B(0, C). This case cannot happen since 
if it does, then f(ip) < f(0) for all ip G B(0, () and this implies 
that is a local maxima point and thus a global maxima point by the 
sufficient condition (SI), and this contradicts to the assumption that 
£ Ra. Therefore, there are no flat regions outside R e . 

Excluding the existence of flat regions outside R t , we now con- 
sider two cases where is either a local minimum point or not. Note 
that the arguments leading to the absence of flat regions outside i? e 
implies that cannot be a local maxima point. 

Case I: If is a local minimum point, we can show that it is an 
interior point of Ue since the fact that is a local minimum point but 
not a local maxima point implies that there exists a £ > such that 
f(ip) > f{0) for all -0 G B(0,£)\{0}. This means that B(0, £) C 
Ue and thus is an interior point of Ue- Note that in this case, 
the entire B(0, £) are in the interior of Ue and we choose A(0) — 
B(0, £) \ {0}, which obviously has nonempty interior points. 

Case II: If is not a local minimum point, it can be shown that 
it is a boundary point of Ue but not an isolated point. First, we show 
that is not an isolated point. If is an isolated point, it means 
that there exists a ( > such that for all %p G B(0,() \ {0}, 
£ Ue, or equivalently, f(ip) < f(0). This means that is a local 
maximum point and thus a global maximum point by the sufficient 
condition (SI). Again, we obtain a contradiction to the assumption 
that (jL R a . Now, since is neither a local maximum point nor 



a local minimum point, then for any £ > 0, we can always find a 
point G B(0,£) such that f(tpi) > f{0), i.e., G (7e and a 
point V> 2 G 5(0, C) such that f(ip 2 ) < f(9), i.e., tp 2 <£ Ug. Thus, 
for any £ > 0, B(0, £) contains both points inside and outside Ug. 
This means that is a boundary point. Note that is an interior 
point in Ug since if it is not, then it is a boundary point of Ug and 
it means /(i/'i) = f(9), which contradicts to the statement that 
f{ipi) > f(9). In this case, we choose A{9) = B(9, £)nU e \ C, 
where C := G Ug : f(if>) = /(#)} and there are nonempty 
interior points in A(9). Therefore, our claim is indeed true. 
Now we define 

n ■- {uj g e : uj = e + G n (S), s e supp(p n )} 

as the set by shifting T n with respect to 9. Then the range of D(9, ■) 
for any 9 g' R t is given by 

Range{D(9,-)} = finUg 

Note that the sufficient condition (S2) implies that 9 is an interior 
point of Q. Since 9 is also a boundary or interior point of Ug, there 
always exist £ > such that B(9, f) H Ue C Range{D (9, ■)}. 
Therefore, we can conclude that A{9) C Range{D(9, ■)}. ■ 
The following proposition states that for any 9 outside R t , there 
is a non-zero probability to improve / by applying a local perturba- 
tion to 9. 

Proposition 2 For any given 9 G O \ R t , there correspond 7 > 
and < rj < 1 such that 

Pr[/(0 + G n («5))-/(0)> 7 ]>»7 
where S is a random vector generated with the probability measure 

fJ-n- 

Proof: Proposition Q] implies that for any 9 G O \ R e , there 
exists an interior point 9 G A(9) and £ > such that Vi/> G T := 
B($,£),fW)-f(fi) > 7 (0). Then, 

Pr[/(0 + G n (S)) - f(9) > 7 (0)] > fi n (T) =: n{9) > 

Note that T is a function of since depends on 0. We complete 
the proof by letting 

7 = inf 7(0) 

eee\« E 

J? = inf 77(0) 

eee\-R e 



Since there is always a non-zero probability to improve /(•) for 
each time step before the sequence reaches R t , the convergence is 
expected. We describe this more precisely in the following theorem. 

Theorem 1 For an objective function f and a transformation G n 
with domain supp(/i n ) that satisfy the sufficient conditions (SI) and 
(S2), let {0["-]}^Lq ^ e a sequence generated from the local random 
search algorithm. Then the resulting sequence converges in proba- 
bility, i.e., given e > 0, 

lim Pr[9[n] G = 1 

71— >oo 

With Proposition^ the proof directly follows the one provided 
in our previous work |6| by replacing the Mag(-) in [6] by a general 
objective function /(■)• We hence omit the details. Note that since 
{/(0[t7])}^L o is non-negative and monotonically non-decreasing, 
this sequence also converges in mean by the Monotone Convergence 
Theorem (7). 



3.2. Linear Scalability 

For the analysis of the scaling law, we use an alternative definition 
of convergence. 

Definition 2 A sequence {0[77]}^ O generated by a random search 
algorithm is said to converge in mean if there exists an M > such 
that 

E {sl m ]} « =omo] [f(0[n])]>f(e*)-e (4) 

for all 71 > M. That is, /(0[77,]) converges to /(0*) in mean. Fur- 
thermore, the iterations required to converge in mean is defined as 
the hitting time. 

With the above definition, we introduce the following theorem 
for linear scalability. 

Theorem 2 Given Q C R , the hitting time of the random search 
algorithm scales linearly with N. That is, there exists k < 00, such 
thatEqn. HJl holds for M < kN. 

By substituting the Mag(-) in |6) by a more general objective 
function /(■) which satisfies the stated sufficient conditions, the 
proof directly follows the one provided in (6). 

Even though the derivation of the proofs for the above two the- 
orems directly follow those in [ 6 1 with only little modification, we 
emphasize again that we do not need to specify the objective func- 
tion and the probability measure used as in [6| once the sufficient 
conditions are satisfied. Therefore, our proofs are more general. 

4. ASYNCHRONOUS SCHEME 

In this section, we model an asynchronous adaptive distributed 
beamforming scheme and analyze its convergence by extending our 
random search framework. We consider the case where at each time 
instance based on the global clock, only p% of the distributed trans- 
mitters update their phases and the rest of them keep their phases 
unchanged. This scenario can be equivalently modeled by assuming 
that each transmitter perturbs its phase independently with probabil- 
ity p — p% at each time slot. This is similar to but different from 
the p% algorithm proposed in f5J since in our case, we assume that 
all the transmitters transmit at all times but only on average p% of 
them change their phases at each time slot. 

Now, we show that this adaptive distributed beamforming 
scheme still converges even when the phases are updated asyn- 
chronously. Similar to the analysis in Sec. [3] we first derive a 
proposition stating that for each perturbation, there is a non-zero 
probability to improve the objective function /. 

Proposition 3 Consider the asynchronous scheme described above, 
then for any given 9 G O \ R e , there corresponds 7 > and < 
A < 1 such that 

Pr [f(9 + G n (S)) — f(0) > 7] > A 

where 5 is a random vector generated with the probability measure 

Pn- 

Proof: We prove the proposition by Bayes' rule. Let Z be the 
event that all transmitters update their phases. Then 

Pr[/(0 + G n (5))-/(0)> 7 ] 

> Pr[f(9 + G n (S))-f(9)>~f\Z]Pr[Z] 

> r\p =: A 

The last inequality follows from Proposition^ ■ 
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Fig. 1. The convergence of (a) the objective function / defined in 
Sec. |5]satisfying the sufficient condition (SI) and (b) the asymmetric 
probability measure satisfying the sufficient condition (S2) 
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Fig. 2. (a) The average iterations necessary for the convergence of 
the asynchronous scheme at different p%. (b) The average conver- 
gence time of the asynchronous scheme with different a 



With Proposition^ we can apply Theorem\l\to show that this 
asynchronous scheme converges both in probability and in mean. 
Note that by applying the simple Bayes' rule, we are able to prove 
the convergence for a much broader set of adaptive distributed beam- 
forming schemes. This demonstrates again the generality and flexi- 
bility of our framework. 

5. SIMULATION RESULTS AND CONCLUSION 

In this section, numerical results are provided to validate our anal- 
yses. We consider a network with N = 200 distributed transmit- 
ters and assume the channel coefficients are i.i.d. C/V(0, 1). Unless 
otherwise specified, we use the SNR function described by l[2j as 
our objective function, set G„(-) to be an identity function, and use 
a random perturbation with the time-invariant probability measure 
p ~ U[— Ao, An] , where U[-, ■] denotes the uniform distribution 
and Ao = 5° in the simulation. Besides, for simplicity, we say 
that the algorithm converges once SNR(0) > o?SNR(0*), where 
a — 0.9. It has been shown in [6] that the SNR function, the prob- 
ability measure fj,, and the transformation (?«(•) considered above 
satisfy both the sufficient conditions. We hence use this setting to 
verify our analyses. 



Fig.Q]shows the convergence of (a) an arbitrary objective func- 
tion satisfying the sufficient condition (SI) and (b) a random pertur- 
bation with probability measure which is not symmetric but satisfies 
the sufficient condition (S2). For Fig. [TJa), we choose the objec- 
tive function to be f(0) = [~ ((& mod "0 ~ \ f + (f ) 2 ] - 
where mod is the modulo function. It can be shown that this function 
satisfies the sufficient condition (SI) and we omit the details due to 
space constraint. For Fig. [T^b), we generate the asymmetric distri- 
bution by randomly shifting p around zero. For both settings, we 
demonstrate that the modified algorithm either with new objective 
function or asymmetric probability measure converges from differ- 
ent initial points. Note that more simulations with different random 
shifts of p have been done and show similar behaviors but are not 
included here due to space constraint. The asynchronous scheme 
described in Sec.|4]is considered in Fig. [2] In Fig.|2ja), we show the 
difference between the asynchronous scheme with different p% and 
the synchronous scheme in terms of the convergence time. This fig- 
ure also shows the average iterations necessary for the asynchronous 
scheme to converge for different p%. It is obvious that the perfor- 
mance of the asynchronous scheme is worse than that of the syn- 
chronous scheme. However, we emphasize that even when only p% 
of the distributed transmitters update their phases at a given time 
instance, the algorithm still converges. Since the convergence be- 
havior from different initial points of the asynchronous scheme for 
any p% is also similar to those in Fig. Q] we omit it due to space 
limitation. In Fig. [2[b), we demonstrate the linear scalability of the 
asynchronous scheme with p% = 50%. We observe that the conver- 
gence time increases with a, and that for any a, the average number 
of iterations necessary for the convergence scales linearly with the 
number of distributed transmitters. These simulation results verify 
our theoretical analyses. 

In this paper, we generalized the proof of convergence for adap- 
tive distributed beamforming schemes that can be reformulated as 
local random search algorithms and satisfy two sufficient condi- 
tions. Specifically, we have shown that such adaptive distributed 
beamforming schemes converge both in probability and in mean and 
their convergence time scales linearly with the number of distributed 
transmitters. We further extended our framework and analyzed the 
case where distributed transmitters can only update their beam- 
forming coefficients asynchronously. Simulations were provided to 
validate our analyses. 
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